DoorGym: A Scalable Door Opening Environment And Baseline Agent

In order to practically implement the door opening task, a policy ought to be robust to a wide distribution of door types and environment settings. Reinforcement Learning (RL) with Domain Randomization (DR) is a promising technique to enforce policy generalization, however, there are only a few accessible training environments that are inherently designed to train agents in domain randomized environments. We introduce DoorGym, an open-source door opening simulation framework designed to utilize domain randomization to train a stable policy. We intend for our environment to lie at the intersection of domain transfer, practical tasks, and realism. We also provide baseline Proximal Policy Optimization and Soft Actor-Critic implementations, which achieves success rates between 0% up to 95% for opening various types of doors in this environment. Moreover, the real-world transfer experiment shows the trained policy is able to work in the real world. Environment kit available here: https://github.com/PSVL/DoorGym/Comment: Full version (Real world transfer experiments result

Association of the OPRM1 Variant rs1799971 (A118G) with Non-Specific Liability to Substance Dependence in a Collaborative de novo Meta-Analysis of European-Ancestry Cohorts

Peer reviewe

Identification of unique neoantigen qualities in long-term survivors of pancreatic cancer

Pancreatic ductal adenocarcinoma is a lethal cancer with fewer than 7% of patients surviving past 5 years. T-cell immunity has been linked to the exceptional outcome of the few long-term survivors1,2, yet the relevant antigens remain unknown. Here we use genetic, immunohistochemical and transcriptional immunoprofiling, computational biophysics, and functional assays to identify T-cell antigens in long-term survivors of pancreatic cancer. Using whole-exome sequencing and in silico neoantigen prediction, we found that tumours with both the highest neoantigen number and the most abundant CD8+ T-cell infiltrates, but neither alone, stratified patients with the longest survival. Investigating the specific neoantigen qualities promoting T-cell activation in long-term survivors, we discovered that these individuals were enriched in neoantigen qualities defined by a fitness model, and neoantigens in the tumour antigen MUC16 (also known as CA125). A neoantigen quality fitness model conferring greater immunogenicity to neoantigens with differential presentation and homology to infectious disease-derived peptides identified long-term survivors in two independent datasets, whereas a neoantigen quantity model ascribing greater immunogenicity to increasing neoantigen number alone did not. We detected intratumoural and lasting circulating T-cell reactivity to both high-quality and MUC16 neoantigens in long-term survivors of pancreatic cancer, including clones with specificity to both high-quality neoantigens and predicted cross-reactive microbial epitopes, consistent with neoantigen molecular mimicry. Notably, we observed selective loss of high-quality and MUC16 neoantigenic clones on metastatic progression, suggesting neoantigen immunoediting. Our results identify neoantigens with unique qualities as T-cell targets in pancreatic ductal adenocarcinoma. More broadly, we identify neoantigen quality as a biomarker for immunogenic tumours that may guide the application of immunotherapies

Interaction of FKBP5, a Stress-Related Gene, with Childhood Trauma Increases the Risk for Attempting Suicide

Childhood trauma is associated with hypothalamic–pituitary–adrenal (HPA) axis dysregulation and is a known risk factor for suicidal behavior. In this study we sought to determine whether the impact of childhood trauma on suicide risk might be modified by FKBP5, an HPA-axis regulating gene. Sixteen FKBP5 haplotype-tagging single nucleotide polymorphisms (SNPs) were genotyped in a sample of African Americans: 398 treatment-seeking patients with substance dependence (90% men; 120 suicide attempters) and 432 nonsubstance-dependent individuals (40% men; 21 suicide attempters). In all, 474 participants (112 suicide attempters) also completed the Childhood Trauma Questionnaire (CTQ). Primary haplotype analyses were conducted with the four SNPs implicated in earlier studies: rs3800373, rs9296158, rs1360780, and rs9470080. We found that childhood trauma was associated with suicide attempt (P<0.0001). Although there was no main effect of the two major yin yang haplotypes in the four SNP haplotype blocks, there was a haplotype influence on suicide risk (p=0.006) only in individuals exposed to high levels of childhood trauma. In this group, 51% with two copies of the risk haplotype, 36% with one copy, and 20% with no copies had attempted suicide. The total logistic regression model accounted for 13% of the variance in attempted suicide. Analyses of the 16 SNPs showed significant main effects on suicide attempt of rs3777747, rs4713902, and rs9470080 and interactive effects of rs3800373, rs9296158, and rs1360780 with CTQ score on suicide attempt. These data suggest that childhood trauma and variants of the FKBP5 gene may interact to increase the risk for attempting suicide